Statement of uncertainty principle for 
o: quantum measurements in terms of 

<n| the Renyi entropies 



r- 



X 



Alexey E. Rastegin 



Department of Theoretical Physics, Irkutsk State University, Gagarin Bv. 20, 
^■. Irkutsk 664003, Russia 

-)— > 

C^ ' Abstract 

O^i The aim of the work is to give the exphcit proofs of the Renyi- 

entropy uncertainty relations presented in the previous work [A. Raste- 
gin, 'arXiv: 0805. 1777]. The relations with both the state-dependent 
and state-independent entropic bounds are proved. For a pair of 
Q^ I POVM measurements the two relations are obtained. The first of 

^^ ' them is generalization of the known results, whereas the second is 

. ■ quite alternative. It is shown that both these relations are meaty. 

O 

lyQ I cussed. The measurements designed for distinction between two non- 

^D ■ orthogonal quantum states are considered as examples. 
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1 Introduction 

The Heisenberg uncertainty principle [1] is primary and most known of those 
results that emboss the fundamental distinctions of the quantum world from 
the classical world. Conceptual development of quantum theory has lead to a 
number of related conclusions such as the Bell inequalities |2l [3] , the quantum 
Zeno effect [1], the no-cloning theorem [5], the interaction-free measurement 
P,[7j, the no-deleting principle [8] and the no- hiding theorem |9]. The general 
quantitative form of the uncertainty principle was given by Robertson [10] . 



Suppose A and B are two observables measured in the quantum state ij). 
The standard deviations A A and AB of the two probabihty distributions 
then satisfy |10] 

AAAB>i|(V',[A,B]V')|, (1.1) 

where (■,■) denotes the inner product. This quantitative formulation of the 
uncertainty principle is best known among physicists. Due to a variety of 
measurement scenarios, many relations have been stated in more detailed 
terms [HI [121 [13] . Fo'^ example, Bohr's principle of complementarity ^14] has 
been quantified by uncertainty relations (see papers [l5l[T6l[T7] and references 
therein) . 

The entropic uncertainty relations provide an alternative way to express 
quantitatively the Heisenberg principle. In many instances these relations 
are more useful characterization. The first entropic relation was proposed 
by Hirschman [18]. Namely, he obtained the relation for position and mo- 
mentum in terms of the Shannon entropies. Hirschman also conjectured an 
improvement of his result. This conjecture has been proved by Beckner [19] 
and by Bialynicki-Birula and Mycielski [20]. The concrete calculations of 
the position and momentum Shannon entropies for the harmonic oscillator 
and the hydrogen atom have been made by the writers of Ref. [21]. But 
important as the case of position-momentum is, it is not able to give under- 
standing the limitations on the information characteristics of measurements 
in all respects. 

In the general context, entropic formulation of the uncertainty principle 
was considered by Deutsch [22]. He emphasized that the right-hand side of 
Eq. (11.11) is not a fixed lower bound but is itself a function of '?/'• Indeed, if the 
state i/j is an eigenstate of A then AA = and the right-hand side of Eq. (11.11) 
vanishes. So no bound on A B is imposed by Eq. (11.11) [23] • Deutsch obtained 
a state-independent lower bound on the sum of the Shannon entropies of 
two probability distributions generated by measurement of two observables 
without degeneracy. Of late years, many other investigations of entropic 
uncertainty relations have been made. The list of corresponding references 
can be found in the previous work of the present author [2^. Here we just 
mention only several papers of interest. 

It turned out that the entropic uncertainty relation given in Ref. [2^ can 
significantly be improved. The sharpened relation has been conjectured by 
Kraus [25] and then established by Maassen and Uffink [23j. However, the 
formulation stated in Ref. [23] deals with two non-degenerate observables. 



A relevant extension to the case of two degenerate observables has been 
obtained by Krishna and Parthasarathy [2S]- Using Naimark's theorem, they 
also generalized their entropic uncertainty relation to the case of a pair of 
arbitrary measurements. The entropic uncertainty relations for sets of A^ + 1 
complementary observables in A^-dimensional Hilbert space were obtained 
[27[ [2B] • In more recent paper [22] , Massar briefly considered the entropic 
uncertainty relation in terms of the Shannon entropies for POVM's, whose 
elements are all rank one j29] . 

Together with the Shannon entropy, other information entropies are ex- 
tensively used in the literature. One of them is the Renyi entropy. In Ref. 
[SO] , Larsen derived uncertainty relations in terms of the so-called purities, 
which are directly connected with Renyi's entropy of order two. Bialynicki- 
Birula obtained the uncertainty relations in terms of Renyi's entropies for 
the position-momentum and angle-angular momentum pairs [31]. In the 
previous work [21], the present author have posed uncertainty relations for 
a pair of arbitrary measurements and for a single measurement in the form 
of inequalities using the Renyi entropies. The aim of the given work is to 
ensure careful proofs of these relations. In addition, more information on the 
subject of the entropic uncertainty relations is provided. 

2 Background 

We shall now describe the notation that is used throughout the text. By 
Ti we denote finite-dimensional Hilbert space. A state of quantum system is 
described by density matrix. Recall that a density matrix is positive semidef- 
inite matrix with unit trace. Let a > and a 7^ 1; then the Renyi entropy 
of order a of probability distribution {pi\ is defined by 



H.{p):=-^\^{Y.^pt} . (2.1) 

This information measure is a nonincreasing function of order a; that is, if 
a < f3 then Ha > -ff/? [32]. The limit a ^ 1 recovers the Shannon entropy 

Hi{p) := -Y. Pilnp, . (2.2) 

In the following, orders of Renyi's entropies are assumed to be different from 
one. The relations for the Shannon entropies can thereupon be obtained by 



taking the limit a ^ 1 in the final inequalities. Unlike the Shannon entropy, 
the Renyi entropy is not a concave function of the probability distribution. 
More precisely, for a > 1 the Renyi entropy Ha{p) is not purely convex nor 
purely concave [33] . 

A generalized quantum measurement is described by "Positive Operator- 
Valued Measure" (POVM). This is a set {Mj} of positive semidefinite matri- 
ces satisfying [511 ISS] 

^.M, = I, (2.3) 

where I is the identity matrix. For given measurement {Mj} and quantum 
state p, the probability of i th outcome is equal to [SU [35] 



Pi = tr{M,p} . (2.4) 

In the mathematical literature, such a set {Mj} is often called "generalized 
resolution of the identity" for the space 7i (for a discussion, see Refs. [361 [37]). 
In the particular case of orthogonal projections, one is called "orthogonal 
resolution of the identity" [361 137] . 

The Renyi entropy Ha{}J\\p) of generated probability distribution is then 
defined by Eqs. 02.11) and 02. 4p . When a quantum state is pure, that is 
p = -0 -0' and ll'j/'ll = 1, we will write ifQ(M|i/'). In this case, 

tr{M,p} = (7/^,M,V') . (2.5) 

Let {Mj} and {N^} be two POVM's, and ij) a pure state. By definition, we 
put the function 

/(M,N|V) :=max||M|/^VirM|N5^VirM(M»'0,NjV)| , (2.6) 

where the maximum is taken over those values of labels i and j that satisfy 
W^i V'll 7^ and ||N- -j/jII 7^ 0. In the case of mixed state p with the 
spectral decomposition 

/> = E,^^aV'1 (2.7) 

we further define 

/(M,N|p):=max/(M,N|0,). (2.8) 

A 

In order to prove the entropic relation, we shall use Riesz's theorem. A 
version of Riesz's theorem is posed as follows [38]. (The below formulation is 
slightly modified in comparison with the one given in Ref. [SB]-) Let x G C"' 



be n-tuple of complex numbers Xj and let tij be entries of matrix T of order 
m X n. Define t] to be maximum of the set \tij\, that is 

7] := max \tij\ . (2-9) 

ij 

To each x assign m-tuple y G C™ with elements 

n 

yi{x) := ^ Uj Xj {i = l,...,m) . (2.10) 

i=i 

So the fixed matrix T describes a linear transformation C" -^ C™. For any 
6 > 1 we also define 



St{x)■.= [}_^^x,\'^ . (2.11) 

Lemma 1 Suppose the matrix T satisfies 

for all X G C"; then 

Saiy)<V^'-'^^'S,ix), (2.13) 

where 1/a + 1/6 = 1 and 1 < b < 2. 

In Ref. [31] this result is appeared as theorem 297. Note that Riesz's 
theorem has been extended to infinite-dimensional spaces by Thorin. In 
functional analysis one is known as the Riesz- Thorin interpolation theorem 
[39] . Of course, the above statement can be obtained from the Riesz-Thorin 
theorem. The needed reasons are contained in Ref. |26] (see the proof of 
theorem 2.1 therein). But the authors of Ref. [26] do not formulate the 
above statement explicitly as an individual result. 

3 Projective measurements 

A projective measurement is described by "Projector- Valued Measure" (PVM). 
This is a set {Pi} of Hermitian matrices satisfying the property 

PjPfc = SikPi , (3.1) 

where 6ik is the Kronecker delta, and the completeness relation 

5^.P, = I. (3.2) 
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The two PVM's {Pj} and {Qj} generate two probability distributions. Due 
to the properties of projectors, the probabihties are rewritten as 

pf = (P,V, P.V) , (3.3) 

gf = (Q,^, Q,V) , (3.4) 

The proof of the following statement is given in Appendix A. 

Proposition 2 For two projective measurements {Pj} and {Qj} and pure 
state ip ETi, 

i7„(P|V') + i//5(Q|V)>-21n/(P,Q|V) , (3.5) 

where orders a and (3 satisfy 1/a + 1/ j3 = 2. 

As it is mentioned above, the Renyi entropy is not generally concave. 
Therefore, the lower bound (13. 5p cannot directly be extended to the case 
of mixed state. The Minkowski inequality, which is very helpful result |3H], 
allows to reach the aim. To clarify the exposition, we consider the mixed 
state a with the spectral decomposition 

a = AVV'^ + (1-A) </j<p"f , (3.6) 

where < A < 1. For the given state a, the corresponding probabilities are 
then rewritten as 

p, = tT{P,a} = \p^^ + il-\)pf , (3.7) 

q, = tr{Q,a} = Agf ^ + (1 - A)gf ^ . (3.8) 

Here the values p^ and q^ are defined by substituting if for ip into Eqs. 
(13.31) and (13. 4p respectively. The argumentation of Appendix A, including 
Eqs. flA.ll|) and flA.121) . are valid for both the pure states ip and (p. So, 



under the same conditions on a and (3, we can write down 

A5„{p(^)}<r^2(i-^)/^A54g(^)}, (3.9) 

(1 - A)5„{p('^)} < r^2(i-/3)//3(i _ X)Sp{q(^^} , (3.10) 

where rj is now equal to /(P,Q|o"), that is the maximum among /(P,Q|'?/') 
and f{P,Q\(p). On this stage the Minkowski inequality should be used. By 
a > 1 and /3 < 1, there hold 

S^{\p^^^ + (1 - A)p(^)} < A5JpW} + (1 - A)5Jp('^)} , (3.11) 

A5^{g(^^} + (1 - A)5^{g(^)} < 5^{Ag(^) + (1 - A)g(^)} . (3.12) 



Summing Eqs. ([S3D and (IXTUj) . due to (IXTTD and (IXT^ we finally get the 
same relation (lA.lip in which the probabilities are already defined by Eqs. 
(13.71) and (13.81) . By those transformations that have lead to Eq. flA.lSp . we 
obtain an entropic relation 

H^{P\a) + H^{Q\a) > -2\nf{P,Q\a) . (3.13) 

The case of mixed state p with the spectral decomposition (12.71) can be con- 
sidered in the same manner. Then the following statement takes place. 

Proposition 3 For two projective measurements {Pj} and {Qj} and any 
mixed state p, 

H^{P\p)+Hp{Q\p) > -21n/(P,Q|p) , (3.14) 

where orders a and (3 satisfy 1/a + 1/(3 = 2. 

4 One of measurement is generalized 

In this section the above result will be extended to the case when one of two 
measurement is described by POVM. Elaborating the ideas of Ref. p6], we 
shall use the Naimark extension. All the necessary details are gathered in 
Appendix B. The following statement takes place. 

Proposition 4 Let {Mj} be a POVM measurement, and let {Qj} be a 
PVM measurement. Then for any mixed state p 

H^{M\p) + Hp{Q\p) > -21n/(M,Q|p) , (4.1) 

where orders a and (3 satisfy 1/a + 1/(3 = 2. 

Proof Substituting Mj for Ej and Qj for Gj in the formulas of Appendix B, 
we will consider the two measurements {Mj} and {Qj} in the enlarged space 
Ti. The measurement {Mj} is projective due to the Naimark theorem. The 
measurement {Qj} is projective, because the measurement {Qj} is projective. 
By the statement of Proposition 3, we then have 

Ha{M\u) + H^{Q\u) > -21n/(M,Q|^) (4.2) 

for arbitrary mixed state u in the enlarged space Ti. To each density matrix 
of the form (12.71) assign the density matrix 



P 



Ex^V'aV'I, (4.3) 



where state vector -0;^ is defined by 







(4.4) 



In the particular case of state p the relation (14 .2 1) is clearly valid. The i/'a's 
form the orthonormal set in the space 7i. Hence we obtain 



V'lV'^ = [^i 0] 







■^Wu = S. 



Xfi 



(4.5) 



So the V'a's form the (incomplete) orthonormal set in the space Ti. Due to 
this fact and the properties of the trace, 

tr{M,p} = J2,^ (^A , M.V'a) = Ea ^ ^^A , M.V'a) = tr{M,p} , (4.6) 

where we use Eq. ( IB.Sp . By a similar argument with Eq. (IB.12p . 

tr{Q,p} = tr{Q,p} . (4.7) 

In other words, we have Pi = Pi and Qj = Qj for any state of the form (14. 3p . 
Therefore, the corresponding Renyi entropies are related by 

H^iM\p) = H^iM\p) , (4.8) 

H^iQlp) = HpiQlp) . (4.9) 

By the relevant substitutions into Eq. (]B.18|) and the definition (12. Sp . 

/(M,Q|p) = /(M,Q|p) . (4.10) 



The last three equalities are valid for arbitrary matrix of the form (14.31) and, 
therefore, for arbitrary matrix of the form (12.71) . But the latter is general 
form of density matrix on the space Ti. So from Eq. (14.21) we immediately 
obtain Eq. i^. U 

5 The main results 

In this section the entropic uncertainty relations for general case will be 
established. We shall first obtain a lower bound on the sum of entropies of 
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two POVM measurements {Mj} and {Nj}. Following the argumentation of 
the previous section, let us substitute M, for Ej and N^ for Gj in the formulas 
of Appendix B. So we will consider the two measurements {Mj} and {Nj} in 
the enlarged space H. The measurement {Mj} is now projective due to the 
Naimark theorem. In general, the measurement {Nj} is not projective. By 
the statement of Proposition 4, for PVM {Mj} and POVM {Nj} we have 

Ha{M\u) + H,3{^\u) > -21n/(M,N|^) . (5.1) 

Here 1/a + 1/(3 = 2 and u denotes an arbitrary mixed state in the enlarged 
space n. Replacing Q^ with N^ in Eqs. (gZD, (USD and fHTTUD . we get 
corresponding equalities for the considered case. That is, 

H^{H\p) = Hp{N\p) , (5.2) 

/(M,N|p) = /(M,N|p) (5.3) 

for arbitrary matrix of the form (14. 3p . Due to Eqs. (14.81) . (15.21) and (15. 3p . 
from Eq. (15. ip we immediately obtain the following result. 

Theorem 5 Let {Mj} and {Nj} be two POVM measurements. Then for 
arbitrary mixed state p, there holdls 

H^iM\p) + H0{N\p) > -2\nfiM,H\p) , (5.4) 

where orders a and (3 satisfy 1/a + 1/(3 = 2. 

The statement of Theorem 5 is generalization of Theorem 2.5 of Ref. 
[2B] in the following two respects. First, this result deals with the Renyi 
entropies instead of the Shannon entropies. Second, it is established for 
arbitrary mixed state. We shall now obtain the entropic uncertainty relation 
for a single POVM presented in Ref. [21]. Suppose that a > 1. For arbitrary 
state p we then have 

/ ^ . Pi — Pmax / J . Pi ~ Pmax ' 

where Pmax is the largest among the probabilities Pi and the normalization 
condition is used. Hence due to Eq. (12. ip we obtain 

i^a(M|p)>-ln0(M|p), (5.5) 

where by definition 

0(M|p) := maxtr{Mip} = p^^^ . (5.6) 



Because the Renyi entropy is a nonincreasing function of order a, Equation 
(15.51) remains valid for a < 1. So we at once get the needed relation. 

Theorem 6 Let {Mj} be a POVM measurement. Then for arbitrary 
mixed state p and any order a > 0, 

i^a(M|p)>-ln</)(M|p). (5.7) 

The both lower bounds in Eqs. (15. 4p and (15. 7p are dependent on the 
state in which a quantum system was before measurement. It is easy to 
obtain state-independent bounds. Such a form of entropic bound is usually 
discussed in the literature. Let us define the norm of operator A by 

1 1 All := max||AV'|| . (5.8) 

||V||=i 

As it is shown in Ref. [2S], there holds 

\{M,il^ ,N,il:)\ < ||M,'/'Nf'|| ||M|/V|| IIN^VII • (5.9) 

By definition, we put 

/(M,N) := max ||MJ/^N;/^|| . (5.10) 

ij 

It follows from Eqs. dM]), ^El and dESD, that 

/(M,N|p) < /(M,N) . (5.11) 

Using Eqs. (15. 4p and (15. lip , we then obtain the desired bound. 

Corollary 7 Let {Mj} and {Nj} be two POVM measurements. For arbi- 
trary mixed state p there holds 

H^{M\p) + Hf,{N\p)>-2\nfiM,N), (5.12) 

where orders a and (3 satisfy 1/a + 1/(3 = 2. 

In the particular case of Shannon entropies this relation was stated in Ref. 
[26] , for one-rank projectors it reduces to the result given by Maassen and 
Uffink [23]. The entropic relations (15.41) and (15.121) have been proved under 
the condition 1/a + 1/(3 = 2. Suppose now that orders a and (3 are arbitrary. 
Due to Eq. (15.71) we can still pose the following uncertainty relation. 
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Corollary 8 Let {Mj} and {Nj} be two POVM's. For any mixed state p 
and arbitrary orders a,(3 & (0; +00), 

H^{M\p) + Hp{U\p)>~\n[(P{M\p)(P{N\p)] . (5.13) 

Note that there is a natural generalization of Eq. fl5.13p to more than 
two POVM's. Finally, we will obtain a state-independent bound for a single 
POVM. Due to the Cauchy-Schwarz inequality and the definition (15.81) . 

\{iP,M,'il,)\<M\\\MM\<mi\\ (5.14) 

for any normalized state V- Let us put the function 

0(M) :=max||M,|| . (5.15) 

i 

By spectral decomposition of p, the linearity of the trace and Eq. (15.141) . 

0(M|p)<0(M). (5.16) 

Using Eqs. (15. 7p and (I5.16p . we lastly obtain 

Ha{M\p)>-\n(j){M). (5.17) 

All the state-dependent and state-independent bounds on the Renyi entropies 
proved in this section have first been claimed by the present author with- 
out proofs [Ml- So the above material is supplementary. In Ref. [2l], the 
entropic bounds are illustrated on the example of distinction between non- 
orthogonal quantum states. In the following, we shall continue examination 
of the obtained entropic relations. 

6 Discussion 

We shall now consider some features of the entropic uncertainty relations 
obtained above. As it is pointed out in Refs. [221 ES], the dependence of 
the bound in Eq. (II. ip on state 1/' leads to some shortcoming. In a certain 
sense, the state-dependent entropic bounds in Eqs. (15. 4p and (15.70 are free 
from this defect. That is, if /(M,N) < 1 then for each state p the bound 
(15.40 is nonzero due to Eq. (15.110 . Further, if 0(M) < 1 then for any p the 
bound (15.70 is nonzero due to Eq. (15.160 . This situation takes place if and 
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only if each of POVM elements has only those eigenvalues that are strictly 
less than 1. In physical applications such a property usually implies that no 
POVM elements are projectors. This is sufficiently common case. In fact, the 
norm of each projector is equal to 1. Further, due to Eq. (12.31) the operator 
(I — Mfc) is positive semidefinite for any fixed k. Hence we have ||Mfc|| < 1, 
that is no eigenvalues of M^ exceed 1. In addition, both the state-dependent 
bounds fl5.4p and (15. 7p can be stronger than the state-independent bounds 
(I5.12P and (I5.13P respectively. 

It must be stressed that inequality (15. lip is always saturated for two 
POVM's consisting of elements of rank one only. Due to the Davies theorem 
|42j . such measurements are sufficient to maximize the mutual information. 
We shall now prove that for POVM's with only one-dimensional operators 
the equality holds in Eq. (15.111) regardless of state p. Let us assume that 

Mi = /iimi m| , (6.1) 

N, = u, nj n] , (6.2) 

for all values of labels i and j. (Note that no summation is taken in Eqs. 
(16.11) and (16.21) .) Here < /Xj < 1, < i/j < 1, and the vectors rrij and rij are 
all normalized. For arbitrary pure state if), we then have 

l|Ml/'VII=/^!/'l(m.,V)|, (6.3) 

||NfVII = ^rKn,,V)|. (6.4) 

Next, we get \{Miip , ^jip)\ = Pi^j \{il^ , mj)(mj , nj)(nj , V')|. Therefore, for 
any if) there holds 

||Ml/VirM|NrVirM(M.V,N,V)| = v/^I^|(m.,n,)|. (6.5) 

1/2 1 /2 I I 

The latter is simply equal to ||Mj N- || accordingly the properties of op- 
erator norm and Eqs. (16. ip and (16. 2p . Combining this with the definitions 
(12. 8p and (I5.10p finally gives the claimed equality. 

Following Ref. [23j, we consider the example of discriminating between 
pure states if^i = Bq and i/'2 — (^o + ei)/-\/2, where Cq and ei are two 
orthonormal vectors. This example is very particular case of the quantum 
hypothesis testing ^3]. In the Helstrom scheme [Ml 136]. which is not error- 
free, the optimal measurement is described by PVM {Ni, N2} with elements 
Ni = u u^ and N2 = v v^, where 

u = cos(7r/8) eo — sin(7r/8) ei , (6.6) 

V = sin(7r/8) Gq + cos(7r/8) ei . (6.7) 
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In the error-free discrimination scheme [HI HH US] the optimal measurement 
is described by POVM {Mi, M2, M3} with elements 

Ml = 2-i/2(v^ + l)-i (eo - ei) (eo - ei)^ , (6.8) 

M2 = v^(v^+l)-'eiel , (6.9) 

M3 = l-Mi-M2. (6.10) 

The elements of both the above POVM's are all rank one. Due to this fact 
and /(M,N)2 = 1/2 [24j, Theorem 5 gives 

H^iM\p) + Hf3{N\p)>\n2 (6.11) 

for any state p. Further, 0(M|V'i) = 2~^/^ and 0(N|V'i) = 2~3/2^^^ ^^ ^^ 
calculations [24|. Corollary 8 then gives 

Ho,{M\i/^^) + Hp{N\il)^) >ln4-ln(y2 + l) . (6.12) 

The right-hand side of Eq. (16.111) is greater than the right-hand side of 
Eq. (16.121) . Thus, for state i/^i the entropic relation (15.41) provides more 
stronger bound than the entropic relation (I5.13p . The difference between 
these bounds is ln(v^ + 1) — In 2 ^ 0.188. In turn, the entropic relation 
(I5.13P can be stronger than the entropic relation (15. 4p . Let us consider the 
eigenstate (p^ of operator M3 which is expressed as 

(^3 = 2-3/4|(v/2 + l)i/2eo + (y2-l)i/2ei} . (6.13) 

For this state Theorem 5 poses the same bound given by Eq. (16.111) . By 
calculations, we further obtain </)(M|(/?3) = {cp^ , M3933) = 2/(v^ + 1) and 
0(N|(^3) = (yjg , Ni£^3) = (yjg , N2£^3) = 1/2. Corollary 8 then gives 

H^{M\cp,) + Hfs{N\cp^) > ln(v^+ 1) . (6.14) 

The right-hand side of Eq. (16. lip is less than the right-hand side of Eq. 
(I6.14p . So, for state cp^, the entropic relation (I5.13P provides more stronger 
bound than the entropic relation (15. 4p . The difference between these bounds 
also is In (-\/2 + 1) — ln2 ?^ 0.188. To sum up, we see that both the entropic 
uncertainty relations (15. 4p and (I5.13P are independently significant. 

Finally, we consider the state-independent bound for a single POVM. 
For projective measurement the trivial lower bound on the entropy is zero. 
This bound can exactly be reached. For POVM measurement an analogue is 
ensured by Eq. flSTTp . Let Mq be a POVM element such that 0(M) = ||Mo||. 
It is known that Hoo{p) = — Inpmax [H]. Thus, in the case a ^ 1 the lower 
bound (I5.17P is approximately reached for an eigenstate of Mq . 
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A Proof of Proposition 2 

In this appendix we prove Eq. (13.51) . Instead of pf and g , we shall further 
write Pi and Qj respectively. For those values of labels i and j that satisfy 
IIPjV'II 7^ and ||Qj'0ll 7^ we define vectors 

u, :=||P,Vir'P.V', (A.l) 

v,-:=||Q,-V||-'QjV- (A.2) 

With no loss of generality, we can mean that 1 <i < m and 1 < j < n. The 
Uj's and the Vj's form the two orthonormal sets. In general, these sets are 
not complete in the space Ti. By definition, put 

tij := (Uj ,Vj) . (A. 3) 

According to Eqs. fl^TTUD and f[OD . 

yi(x) = (ui,w) , (A.4) 

where w := Ylj^j'^j ^J definition. It is clear that the vector YliVi^i i^ 
orthogonal projection of w onto the subspace spanned by Uj's. So we get 

y^.b^r<iiwir. (a.5) 

On the other hand, due to the definition of w and (vj , v^) = 6jk we have 

^ — ^3 



Iw||2 



Therefore, the condition (12.121) is satisfied for all x G C". So we can apply 
Eq. (I2.13p . We shall now use this result for the values 

y^ = \\PM, (A.7) 

xj = \\QM- (A.8) 

Both the PVM's {Pi} and {Qj} satisfy the completeness relation. Substitut- 
ing this in the identity -j/j = I -0, in terms of the above values we have 

ip = ^ ykUk = Y^ . XjVj . (A.9) 
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Combining the relation (u, , u^) = 5ik with Eq. (lA.9p . we get 

yi = y^.{^i^^j)xj . (A. 10) 

Thus, the values given by Eqs. (lA.Tp and (JA.Sp are really connected by Eq. 
fl2.10p with the matrix elements (lA.Sp . Further, pi = ||/jp and qj = |xjp due 
to Eqs. (13. 3p and (13. 4p . Let us put a = 2a and b = 2(3. Squaring Eq. (I2.13p . 
after substitutions we obtain 

So.{p)<r,^^'~^^'^Sp{q), (A.ll) 

where 1/a + 1/(3 = 2, 1/2 < /3 < 1 and 

f] = max |(ui ,Vj)| . (A.12) 

Using the definition of Ha{p) by Eq. (12. ip . we get 

\nS^{p) = ^-^^H^{p). (A.13) 

a 

In the same way the quantities Sp{q) and Hp{q) are related. It then follows 
from Eq. (lAJTl) and (1 - /5)//3 > that 

^-^-^ H^[p) <2\nr, + Hp{q) ■ (A-M) 

a(l — (3) 



When l/a + l/(3 = 2 and a, /3 7^ 1, the multiplier of Haij)) in Eq. (lA.14p is 
equal to (—1). So we can rewrite Eq. (1A.14P as 

H^{p) + Hp{q)> ~2\n7]. (A.15) 

For projectors we clearly have Pj = P/ and Qj = Q^ . So due to Eqs. 
(jAU) and (1X2]) the right-hand side of Eq. (1X12]) is equal to /(P,Q| V')- This 
concludes the proof for a > fi. By permutation of the two PVM's, we recover 
the case when the order of entropy of PVM {Qj} is greater than the order 
of entropy of PVM {P,}. 
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B Naimark's extension and related questions 



We shall now describe the version of Naimark's extension stated in Ref. [lO] . 
Let {Ej} be a set of positive semi definite matrices satisfying 



E.E. 



I 



H 



(B.l) 



where In is the identity operator in the space Ti. Naimark proved that 
each generalized resolution of the identity can be realized as an orthogonal 
resolution of the identity for the enlarged space Ti which contains 7i as a 
subspace jSH, EZl SI] • Let us define 



n:=n®c 



(B.2) 



where £ is a space of needed dimensionality. As it is interpreted by Partha- 
sarathy [3D], we can build partitioned matrices of the form 



E,;: = 



Ej Ri 

RJ L,; 



(B.3) 



so that the Ej's are orthogonal projections in the enlarged space 7i and 

J].E, = I. (B.4) 

Here the matrix I represents the identity operator in the space ?i. In Eq. 
(IB.3P the orders of sub matrices Rj and Lj should be clear from the context. 
An arbitrary vector in the enlarged space is represented by the column 



(B.5) 



with u G 7Y and z G £. The entries of this column are components of U with 
respect to the orthonormal basis in ?i that is obtained by extension of the 
initial basis in l-i. 

To each -0 G 7i assign the vector -0 G 7i defined by 



^■r- 







(B.6) 
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Here and below denotes the matrix of needed order consisting of all zeros. 
Following the rules of block multiplication, we have 



V E.V' = [V'^ 0] 



■E.V' 



V'^E.V 



In other words, the probability of getting outcome i, equal to 

(V'.EiV') = (V'.Ei'j/') , 



(B.7) 



(B.8) 



is not changed under the made extension. 

Let {Gj} be another resolution of the identity for the space 7i. To each Gj 
assign the operator Gj acting on the space H. In the matrix representation, 
we define these operators as follows: 



Gi:= 



Gi 






, G,: = 


G, 



0" 




U + 1) • 



(B.9) 



Here the identity matrix I^ of corresponding order describes the action of 
the identity in the subspace L. Because the Gj's form a resolution of the 
identity for the space H, we then have 



(B.IO) 



^~^' 


= 1 


Further, for all U G 7i there holds 


'^G^ = [u"^ 2"^] 


GjU 

6jiz_ 


= 



u^GjU + 5ji 



z'z 



fB.lll 



So each Gj is positive semidefinite due to the positive semidefiniteness of the 
Gj's. Therefore, the set {Gj} is a resolution of the identity for the space TC. 
In addition, if the resolution {Gj} is orthogonal then the resolution {Gj} is 
also orthogonal. By Eq. (IB. HP . for any state of the form (]B.6P we have 



(V' , GjV') = V' Gji/' = t/j^GjV' = (V' , GjV') 



[B.12) 



Thus, for second measurement the probability of getting outcome j is also 
not changed under the made extension. To sum up, we can say the follow- 
ing. Starting with the two POVM measurements {Ej} and {Gj}, we have 
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constructed the two measurements {Ej} and {Gj} in the enlarged space H. 
But the first measurement {Ej} is now projective. 

For any positive semidefinite operator there exists a unique positive square 
root. Further, each positive semidefinite operator is Hermitian. Using these 
facts and the definition of the norm, we get 



:l/2„ 



:l/2 



ErV'll =(ErV',E:^» = (V',E,V). 



l/2„ 



Combining this with Eq. (1B.8|) finally gives 



:l/2 



l/2„ 



^r^\\ = m' H 



[B.13) 



[B.14) 



for every state of the form (IB. 61) . In the same manner, due to Eq. (IB.12P we 
obtain 

IIGj/VlHIICfVII- (B.15) 

By matrix calculations, we also have 



V E,G,V = [V^ 0] 



Ej Rj 
RJ U 







^I^^EiGjtl) 



(B.16) 



By Hermiticity of the POVM elements, in terms of inner products one gives 

(E,V',G,V') = (E,V,G,V) • (B.17) 

Together with Eqs. (IB. 140 and (IB.15P the last equality implies 

/(E,G|V') = /(E,G|V) . (B.18) 



Equation (IB.ISP is valid for arbitrary state vector of the form (IB.6p . Here 
the one fact should be pointed out. By calculations. 



'^P^E^E^^P = V^E,E,V + V'^R^RIV • 



[B.19) 



The last equality implies that 1 1 Ej?/' 1 1 ^ 1 1 Eji/' 1 1 in general. It is for this reason 
that the square roots of operators are inserted into the fraction denominator 
in the right-hand side of Eq. (12. 6p . 
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